TITLE OF THE INVENTION: 
Optical Coding of Position Information on Printed Surfaces 

CROSS-REFERENCE TO RELATED APPLICATIONS: 
The present invention relates to subject matter somewhat similar to that in the 
co-pending, commonly assigned application of Guy de Warren Bruce Adams 
and Doron Shaked, entitled "Visually Significant Marking in Position Encoded 
Glyph Carpets", filed October 27, 2003, Lowe Hauptman Oilman & Bemer 
Docket No. 1509-461. 

STATEMENT REGARDING FEDERALLY FUNDED RESEARCH OR 

DEVELOPMENT: 
Not Applicable 

INCORPORATION BY REFERENCE OF MATERIAL SUBMITTED ON 

COMPACT DISC: 
Not Applicable 

BACKGROUND OF THE INVENTION: 

Technical Field 

[OOlJ The present invention relates to methods of and apparatus for determining 
location codes on surfaces. More particularly, although not exclusively, the invention 
relates to improvements in generating optically detectable location codes on printed 
surfaces. 

Background Art 

[002] There are a number of types of optically detectable codes which can be printed 
on a surface and can be used to encode digitized data of virtually any form. 

[003] Such optically detectable codes are known as glyphs or dataglyphs. A glyph is 
an optically detectable character or mark which carries encoded data by means of 
optically distinguishable characteristic such as shape. 

[004] An important application is where glyphs are used to encode the physical 
position of points on a surface. Glyphs used for this function are called Address Codes 
or Position Codes. Such codes can be read using an optical reader and decoded to 
determine the position of the reader on the page. 
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[005] In this case, glyphs are usually positioned on the surface at the vertices of an 
accurately specified lattice or grid. The location data which is encoded into the glyphs 
represents the physical location of that particular point on the surface. 

[006] An example of position encoding glyphs is given in US patent 6,548,768 to 
Anoto AB. According to *768, the glyph is a combination of the position of a visible 
dot in relation to an invisible virtual grid vertex reference point. The layout of the 
virtual grid is defined by the overall arrangement of the visible dots and is deduced by 
imaging a number of dot locations. The actual data is decoded by determining the 
position of the visible dot in relation to its virtual grid vertex reference point. For four 
dot positions around the grid vertex, four unique values can be encoded in any one 
grid position. 

[007] Another example of position codes is disclosed in IEEE Publication 0018- 
9162/10 entitled "Printed Embedded Graphical User Interfaces" by Hecht. Here, two 
unique glyphs are used, a 7' to encode a 0 and a *\* to encode a 1 and are arranged on 
in regular array. The code is a self-clocking code which means that each glyph is 
encoded to represent data at each position and the actual presence of the glyph is the 
clocking mechanism. 

[008] Position Codes thus enable finely resolved user selection of printed objects. 
Thus they can be used in paper-based GUI systems which follow the traditional point- 
and-click paradigm. 

[009] Glyph position codes can also be used to establish the position of the reference 
lattice or grid either directly, as in the case of Hecht, or indirectly as disclosed in *768. 

[0010] Glyphs are often designed as unitary characters where the encoding is 
represented by the intrinsic optical structure of the character. In the case of 7' and *\' 
this intrinsic character is the orientation of the stroke. However, a glyph can also be 
constituted by the geometrical relationship between an optically detectible feature and 
a fixed reference point as in the case of the Anoto disclosure. 

[0011] Two of the major issues with optical encoding of any kind are firstly the 

requirement that the glyphs not unduly interfere with the appearance of the page as a 

whole. Secondly, reasonably high coding densities are required in order to encode 
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useful amounts of information into a given page area. The present invention attempts 
to address these issues by providing a glyph position code system which is optically 
neutral to the observer and has improved data encoding capacity. 
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Sununary of the Invention 



[0012] In one aspect, the invention provides an optically detectable data encoding 
layout for a surface, the data encoding layout including: 

a primary lattice; 

a secondary lattice formed in the interstitial areas formed by the 
primary lattice; 

one or more secondary markings located on points on the secondary 
lattice wherein the data is encoded according to the positions of the 
markings on the secondary lattice. 

[0013] The primary lattice is preferably defined by a plurality of primary markings, 
each located at the vertices of the primary lattice 

[0014] Preferably, the data encoding corresponds to location encoding which specifies 
the physical location of each secondary marking on the page. 

[0015] Preferably, the physical location of the secondary marking on the page can be 
decoded to provide a logical page-space location, where the logical page-space is 
defined by the largest unique page area which is possible given a specific location 
encoding algorithm. 

[0016] Preferably, the primary lattice is a regular substantially square lattice, 
rectangular, triangular or other regular lattice shapes. 

[0017] In an alternative embodiment, the pitch of the primary and/or the secondary 
lattice varies depending on the physical position on the page. 

[0018] Such primary and/or secondary lattice pitch variation may be discontinuous or 
alternatively the variation may be progressive. 

[0019] The primary and/or secondary lattice pitch variation is preferably such that a 
reading device, detecting and decoding the marks within a specified field of view, is 
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able to detect and compensate for the pitch variation so as to distinguish the primary 
and secondary lattice. 

[0020] In a preferred embodiment, the primary lattice has a primary marking at a 
sufficient number of lattice points so that the position of the primary lattice can be 
determined from the positions of the primary markings. 

[0021] The primary and/or secondary markings are preferably dots having no intrinsic 
optically distinguishable structure. 

[0022] hi an altemative embodiment, the primary and/or the secondary markings have 
an intrinsic structure which allows additional data to be encoded therein. 

[0023] hi a further aspect, the invention provides an article incorporating encoded 
information by means of the data encoding layout as hereinbefore defined. 

[0024] hi yet a further aspect, the invention provides a method of encoding data onto 
a surface including the steps of: 

applying to the surface primary maiidngs, sufficient to define a primary lattice 

applying data encoded markings in payload regions defined by interstitial 
areas between lattice points of the primary lattice, wherein the primary lattice 
specifies a reference coordinate system for evaluating the positions of the data 
encoding maiidngs in the payload regions. 

The data preferably corresponds to location data such that if the markings are 
imaged and decoded, the decoded data represents the position of the imaged 
area on the page. 

[0025] The encoded data is preferably digitized data wherein when a plurality of the 

markings is imaged; the digitized data can be reconstructed from the decoded data 

Brief Description of the Drawings 

[0026] The present invention will now be described by way of example only 
and with reference to the drawings in which: 
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Figure 1 is an illustrative example of a square primary lattice with primary 
markings at each lattice point; 

Figure 2 is an illustrative example of the primary lattice of figure 1 populated 
with secondary markings; 

Figure 3 is an illustration of a primary lattice with markings placed in pa>ioad, 
or interstitial, areas between the primary lattice points; 

Figure 4 is an illustration of a detailed view of a primary and secondary lattice 
with primary markings on four of the primary lattice points and two secondary 
markings populating adjacent secondary lattice areas; 

Figure 5 is an illustration of a shape alphabet where the markings have 
optically distinguishable intrinsic structure; and 

Figure 6 is an illustrative example of a primary lattice partially populated with 
secondary markings between the primary lattice points located on the lattice 
lines* 

Detailed Description of the Drawing 

[0027] Referring to Figure 1, a primary lattice is shown with each lattice point 11a, 
1 lb... populated by a primary marking. The primary lattice is regular with a square 
unit shape. The function of this lattice is to define and allow the areas 12 which are 
occupied by the secondary lattices to be accurately located. 

[0028] A primary lattice with no secondary lattice points such as that shown in Figure 
1. has a substantial visual impact and creates an image which would be visually 
intrusive if it alone was used as a printed background on a page. Additional visual 
interference such as banding may be apparent as, in practice, this primary lattice 
would be relatively small. 

[0029] Payload areas 12 between the lattice points of the primary lattice are populated 

with secondary markings. The result is shown in Figure 2. Figure 2 incorporates the 

same primary lattice (11a, 1 lb. . .) as Figure 1 but includes a pajdoad corresponding to 

two secondary markings 21a and 21b per unit cell 12. These secondary markings are 

-6- 



called the payload as they are carried in a specified region between the primary lattice 
points. 

[0030] It has been found that inserting a relatively small number of secondary 
markings per unit cell into a regular primary lattice substantially nullifies the intrusive 
optical effect of the regular pattern in the primary lattice. 

[0031] In the embodiment shown, the primary lattice markings specify a lattice which 
forms the reference grid for positioning the secondary markings. The secondary 
markings encode data by means of their position within the payload area 12 and this 
payload area is shown in more detail in figures 3 and 4. 

[0032] Referring to Figure 4, the same primary lattice as in Figure 1 is populated with 
primary markings at its lattice points 11. The payload regions 61 (see Figure 3) are 
shown as 4 by 4 unit areas (i.e.; 5 by 5 grid intersections) on which secondary 
markings 74 are located. The payload region does not extend to the fiill area defined 
by the primary markings. This is to ensure that the secondary markings in the payload 
region 61 are not located too close to the primary lattice points as the result can be 
visually intrusive as the effective optical density is not dispersed. 

[0033] The primary lattice can be extracted firom the secondary lattice by a number of 
methods. In one embodiment, the primary lattice point markings are the same shape 
as the secondary lattice point markings. That is, the primary and secondary markings 
are individually optically indistinguishable. When a page portion is imaged, the 
primary lattice point markings can be determined according to pattern extraction 
algorithms which are known in the art. Such methods take groups of markings and 
extracts continuous, regularly spaced parallel rows of markings fi-om them. These 
parallel lines correspond to the grid lines of the primary lattice. Other techniques are 
possible including diflfraction-based optical spatial filtering where the tsvo-dimension 
Fourier transform of a regular dot grid pattern having a specified pitch is subtracted 
firom the Fourier transform of the whole pattern. When the image is reconstructed only 
the secondary markings will remain. It is also possible to ensure that when encoded, 
sufficient secondary lattice to lattice variation, or dither, occurs. This will assist the 
pattern extraction method. 
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[0034] Such techniques are known in the mathematical and image processing arts 
and, for brevity, will not be discussed in detail. It is not necessary for each and every 
primary lattice vertex point to be occupied by a primary marking. It is sufficient that 
the extraction algorithm be able to determine the layout of the primary lattice within 
the inherent accuracy of the imaging device. For example, with a relatively narrow 
field of view, a larger proportion of primary lattice points will need to be occupied. 
With a large field of view, fewer primary lattice points will need to be occupied. To 
this end, it is envisaged that wifli a suflBciently wide field of view, the primary lattice 
may have a substantial number of lattice points vacant. In an extreme case it may be 
possible to have all primary lattice points vacant with the primary lattice being 
determined by the overall payload locations and absence of primary markings spread 
over a large field of view. 

[0035] According to ano&er embodiment, the primary lattice markings may have a 
different shape to the secondary markings. This allows a relatively straightforward 
extraction technique as the primary grid is easily recognisable by an imaging system. 
This embodiment may be susceptible to optical artefacts caused by the optically 
distinguishable primary or secondary lattice. These artefacts may be kept to a 
minimum by keeping the density low as in Fig 4 where they do not appear at all 
points, but at a spatial density sufficient such that an imaging device is capable of 
detection and extraction within its field of view. 

[0036J The primary lattice allows perspective, skew and rotational corrections which 
may be needed depending on what type of imaging device is used. 

[0037] The secondary lattice markings encode data according to their position in the 
payload area. Referring to Figure 4, the payload area is a 5 by 5 grid into which one 
marking is placed. This would encode 5x5=25 points. If the imaging device is capable 
of imaging an area sufficient to decode the contents of the 4 by 4 primary (and 
secondary) lattices (i.e.; 16 in total), this would provide a maximum of (5x5)*^ = 
3.8x10^^ encoding values. 

[0038] The data encoding space can be increased using additional secondary 
markings as shown in Figure 1. 
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[0039] The data encoding space can be further using secondary markings which 
encode additional data into the mark by virtue of intrinsic properties of the mark. Such 
a property is the shape of the mark. To this end, reference is made to applicants 
copending, commonly assigned application of Guy de Warren Bruce Adams and 
Doron Shaked, entitled Visually Significant Maiking in Position Encoded Glyph 
Carpets, Lowe Hauptman Gilman & Bemer, LLP, filed October 27, 2003, docket 
number 1509-461, the disclosure of which is incorporated by reference. Using this 
technique, two levels of data encoding are possible based on the position of the mark 
in the payload area as well as the shape of the mark itself An example of a set of 
glyphs having intrinsic shape-based optical characteristics is shown in Figure 5. At a 
first level, these glyphs are able to encode data by means of their location in the 
payload area. At a second level, they encode fiirther data by means of the specific 
shape of the marking. 

[0040] In a fiirther embodiment, shape encoding as described in the abovementioned 
document may be applied to the primary lattice markings and used to encode 
reference, synchronisation or other information which may be needed to accurately 
specify the primary grid shape and layout. 

[0041] The encoding values given above are the maximum theoretical values for the 
given cases. They do not take into account reductions that will occur when measures 
such as sequence design (windowing algorithm), for example, pseudorandom binary, 
is included to enable the imaging device to be able to decode a unique position fi-om 
any defined minimum set of lattice points. Further reductions in encoding efficiency 
will result fi-om data redundancy encoding etc. 

[0042] There are no limits on the pitch of the grid/size of the markings except those 
imposed by the printing and/or imaging technology as well as the intended use model. 
For example, documents would use a different pitch compared to a large poster. 

[0043] Typically for a document a primary lattice pitch would be between 0.5 and 

2mm with the secondary lattice pitch being l/8th of this. Conveniently with a 

boundary region of 2 secondary lattice increments this yields a central payload lattice 

of 5 by 5. At these dimensions the actual grid pitch will be determined by the printer 

capability. Laser marking engines differ from inkjet and LEP etc. However, when 

-9- 



their smallest reliable marking characteristics and placement solutions are factored in, 
the pitch can be specified that will leave discemable marks on the secondary lattice. 

[0044] In use the invention provides a very uniform appearance with the glyph 
background not interfering substantially with any foreground information. 

[0045] In an altemative embodiment, the payload markings can be located along the 
lattice gridlines as shown in Figure 5. Althougji diis may produce a more significant 
background optical effect, this arrangement may be useful in certain situations. For 
examples maths based pages or particular forms where the more regular structure is 
not visually detrimental. In this case, the secondary lattice is the extreme case of the 
general description with only the outermost secondary lattice points utilised. 

[0046] In a fiirther embodiment, it is envisaged that it would be possible to vary the 
primary and/or the secondary pitch as a fimction of the position on the page. This may 
be to take into account obscuring material overprinted on the particular portions of the 
page or other constraints on the optical density of the background image. 

[0047] For example, ttie lattice pitch may be smaller at the top of flie page than at the 
bottom of the page with the pitch changing linearly as a fimction of the vertical 
position on the page. That is, the primary and secondary markings are closer together 
at the top than they are at the foot of the page. In such a case, so long at the imaging 
device can see sufficient primary lattice markings within a specified range of pitch 
geometry, it could still successfully extract the primary lattice fi"om the imaged view, 
determine the position of the payload and calculate the position of the imaging device 
at the particular position on the page. Thus, there would be need to be specified a 
maximum rate of change of pitch over the field of view of the imaging device above 
which no reliable position extraction would be possible. 

[0048] In another example, tiie lattice pitch may change discontinuoiisly. If this pitch 
change occurs within the field of view of the imaging device and the primary lattice is 
capable of extraction on either side of the discontinuity, the successful primary lattice 
extraction and determination of the payload position will still be possible. 

[0049] It is envisaged that tiie capability of detecting either gradual or discontinuous 

changes in the pitch of the primary/secondary lattices would be built into the image 
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processing software of the imaging device and an implementation of this is considered 
to be within the purview of one skilled in the art. 

[0050] Although the invention has been described by way of example and with 
reference to particular embodiments it is to be understood that modifications and/or 
improvements may be made without departing from the scope of the appended claims. 
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